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Hfi MzUHEAB QUANTIZER FOR VIDEO CQBIMS 

RIOTED APPLICATION 

This application claims the benefit of priority 
5 afforded by provisional application no. 60/038,016 filed 
February 14, 1997, the disclosure of which is incorporated 
herein. 

B & C KSBSUHQ of the INVENTION 

10 The present invention related to a quantizer for use 

in image coding. 

It is known to scale discrete cosine transformation 
coefficients in video coding applications to conserve 
bandwidth. Known systems either scale by a small 

15 constant, such as divide by 8, or scale by a linear 
scaling factor that is twice a quantization parameter (2 
x Q p ) . Scaling by the small constant does not achieve 
significant bandwidth savings. Scaling by the 2+Q p linear 
scaling function achieves significant bit savings, but 

20 results in poor image quality at lower and mid-level Q p 
values particularly in the chrominance video signals. 
Accordingly, there is a need in the art. for a quantizer 
characterized by a scaling function that achieves good 
signal quality, and achieves bit rate savings for all 

25 values of Q p particularly for chrominance. 
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An encoder and decoder must use the same quantization 
parameter to encode and decode video information 
intelligibly. Known systems report changes to the 
quantization parameter with codes that cause changes in Q p 
5 with a uniform step size, regardless of the value of Q p . 

Experience teaches that, at low values of Q p/ changes 
in Q p are relatively small. However/ for large values of 
Q p , changes in Q p values are relatively large. Systems 
that allocate additional bits to report the larger Q p 

10 changes waste bandwidth at the lower Q p values where the 
large changes do not occur. However, systems that limit 
the number of bits available to coding Q p changes may 
become saturated if larger changes must be coded. 
Accordingly, there is a need in the art for a quantizer 

15 that reports both large and small changes in Q p with a 
minimum number of bits. 

SU MMARY O F THE INVgNTSQfl 

The disadvantages of the art are alleviated to a 
20 great extent by a quantizer that applies a non-linear 
scaling function based on the quantization parameter. A 
different scaling function applies for luminance data than 
chrominance data. Both scaling functions at low Q p values 
approximate constant scaling functions. At large Q p 
25 values, the luminance scaling function approximates a 2*Q P 
scaling function and the chrominance scaling function 
approximates a 1*Q P scaling function. The quantizer may 
include a non-linear scaling function for AC coefficients. 
The present invention may include a way to update 
30 values of Q p . Changes in Q p are reported in a fixed length 
code, but each code means different things based on the 
previous values of Q p . If the previous Q p value is large, 
the code represents a larger change than if the previous 
value of Q p were small. 



2685:1 12183 [Hwkell 60-25-10] 



136403 



3 



BRIEF DE SCRIPT T ON OF THE FIGURES 

Fig. 1(a) is a block diagram of a first embodiment of 
an encoder 100 of the present invention; Fig. 1 (b) is a 
block diagram of a first embodiment of a decoder 200 of 
5 the present invention. 

Fig. 2 is a block diagram of a portion of the 
quantizer of Fig. 1. 

Fig. 3 is a block diagram of a portion of the scaling 
circuit of Fig. 1. 

10 

PSBMEBP DESCRIPTION 

Fig. 1 shows an encoder 100 constructed in accordance 
with a first embodiment of the present invention. An 
analog image signal is presented to the encoder 100. The 

15 image signal is sampled and converted to a digital signal 
by an analog to digital ("A/D") converter 110 using 
techniques known in the art. The A/D converter 110 
generates a digital image signal for a plurality of pixels 
of the image. Alternatively, the image signal may be 

20 presented to the encoder 100 as a digital image signal; in 
this case, the A/D converter 110 is omitted. 

The digital image signal is input to a processing 
circuit 120. The processing circuit 120 may perform a 
host of functions. Typically, the processing circuit 120 

25 filters the image data and breaks the image data into a 
luminance signal component and two chrominance signal 
components. Additionally, the processing circuit 120 
groups image data into blocks, of data. Where the digital 
input signal represents information for a plurality of 

30 pixels in a scanning direction, the digital output of the 
processing circuit 120 represents a block of pixels, for 
example an 8 pixel by 8 pixel array of image data. The 
processing circuit 120 outputs image data on a macro block 
basis. A macro block typically consists of up to four 
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blocks of luminance data and up to two blocks of 
chrominance data. The processing circuit 120 may also 
perform additional functions, such as filtering, to suit 
individual design criteria. 
5 The output of the processing circuit 120 is input to 

a transform circuit 130. The transform circuit 130 
performs a transformation of the image data, such as 
discrete cosine transform ("DCT") coding, from the pixel 
domain to a domain of coefficients. A block of 64 pixels 

10 is transformed to a block of 64 coefficients. 
Coefficients output by DCT coding include a single DC 
coefficient and 63 AC coefficients, few of which are non- 
zero. The transform circuit 130 outputs blocks of 
coefficients organized into macro blocks. 

15 A quantizer 140 scales the DC and AC coefficients 

generated by the prediction circuit 150 according to a 
non-linear scaling function governed by a variable 
quantization parameter (Q p ) . The quantization parameter is 
a value determined by the bit rate of the channel, the 

20 resolution of the image being coded, the type of image 
coding (intra or inter) and other factors that affect a 
number of bits that may be allocated to coding of the 
macro block. Q p is updated on a macro block by macro block 
basis; changes in Q p are reported in an output bitstream. 

25 In MPEG coding, Q p takes on values between 1 and 31. The 
quantizer 140 reduces bandwidth of the image signal by 
reducing a number of quantization levels available to 
encoding the signals. Many small coefficients input to 
the quantizer 140 are divided down and truncated to zero. 

30 The scaled signals are output from the quantizer 140. 

The output of the quantizer 140 is input to a 
prediction circuit 150. The prediction circuit 150 
performs gradient prediction analysis to predict the DC 
coefficient of the block. The prediction circuit 150 may 
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pass the AC coefficients generated by the transform 
circuit 130 or, alternatively, may predict AC coefficients 
of the block. In a preferred mode of operation, the 
prediction circuit 150 selects between modes of predicting 
5 or passing AC coefficients; in this case, the prediction 
circuit 150 generates an AC prediction flag to identify a 
mode of operation. The prediction circuit 150 outputs DC 
coefficient signals and AC coefficient signals 
(representing either AC coefficients or AC residuals) on 

10 a macro block basis and, on a macro block basis 
optionally, an AC prediction flag. 

A variable length coder 160 encodes the output of the 
quantizer 140. The variable length coder 160 typically is 
a Huffman encoder that performs run length coding on the 

15 scaled signals. A bitstream output from the variable 
length coder 160 may be transmitted, stored, or put to 
other uses as are known in the art. 

A decoder 200 performs operations that undo the 
encoding operation described above. A variable length 

20 decoder 2 60 analyzes the bitstream using a complementary 
process to recover a scaled signal. If a Huffman encoder 
were used by the encoder 160, a Huffman decoder 260 is 
used. 

A reconstruction circuit 250 performs the identical 
25 gradient analysis performed in the prediction circuit 150. 
The DC residual signal is identified and added to a 
predicted coefficient to obtain a DC coefficient. 
Optionally, the reconstruction circuit 250 may identify 
the AC prediction flag and, based on the status of that 
30 flag, interprets the AC information as either AC 
coefficient information or AC residual information. In 
the event that AC residual information is present, the 
reconstruction circuit 250 adds the residual signals to 
corresponding predicted signals to obtain AC coefficients. 
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The reconstruction circuit 250 outputs coefficient 
signals . 

A dequantization circuit 240 multiplies the recovered 
signals by the same scaler values used at the quantizer 
5 140. Of course, those coefficients divided down to zero 
are not recovered. 

An inverse transformation circuit 230 performs the 
inverse transformation applied by the transform circuit 
130 of encoder 100. If DCT transformation were performed, 
10 an inverse DCT transformation is applied. So, too, with 
sub-band coding. The inverse transformation circuit 230 
transforms the coefficient information back to the pixel 
domain. 

A processing circuit 220 combines luminance and 
15 chrominance signals and may perform such optional features 
as are desired in particular application. The processing 
circuit 220 outputs digital signals of pixels ready to be 
displayed. At this point the signals are fit for display 
on a digital monitor. If necessary to fit a particular 
20 application, the signals may be converted by a digital to 
analog converter 210 for display on an analog display. 

The present invention achieves bit rate savings by 
applying a non-linear scaler function at the quantizer 140 
to obtain bit rate savings at high Q p levels but ensure 
25 high video quality at low Q p levels. The quantizer 14 0 
applies different scaler functions depending upon the type 
of data being quantized (luminance or chrominance), the 
type of coefficient being quantized (DC or AC) and the 
type of coding (inter or intra) being performed. 

30 

NON-LINEAR QUANTIZATION OF DC COEFFICIENTS FOR LUMINANCE 
AND CHROMINANCE 

35 For DC coefficient information, the scaler functions 

vary with Q p . Different piece-wise linear scaler functions 
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are applied to DC luminance and DC chrominance signals. 
To minimize objectionable artifacts within the chrominance 
signal, the DC chrominance scaler is smaller than the DC 
luminance scaler for all Q p values. 
5 The DC luminance scaler function for low Q p values is 

a constant. For large Q p levels, the DC luminance scaler 
function approximates a 2*Q p function. The inventors 
obtained through experimentation the DC scaler function 
shown in Table 1 below, used in an embodiment of the 

10 invention. 

The DC chrominance scaler function is also at a 
constant at low values Q p . At high Q p values, the DC 
chrominance scaler function approximates a linear scaler 
function in Q p . The inventors obtained through 

15 experimentation the DC scaler function for chrominance 
signals shown in Table 1 below, used in a preferred 
embodiment . 



Component 


DC Scaler for Quantizer (Qp) Range 
1 through 4 5 through 8 9 through 24 25 through 31 


Luminance 


8 


2*Q P 


Q p +8 


2*Q P -16 


Chrominance 


8 


(Q p +13)/2 


(Q p +13)y2 


Q p -6 



Table 1 



Rather than compute the DC scaler for each value of 
Q p , further efficiencies may be obtained by storing the DC 
2 5 scaler functions for luminance and chrominance for all 
values of Q p in a memory table at the quantizer 140. In 
this event, the quantizer 140 includes a small memory of 
DC scales for luminance and chrominance that may be 
indexed by Q p as shown in Table 2 below. 
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23 
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16 
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14 


17 


25 


15 


18 


26 


15 
i w 


19 


27 


16 


20 


28 


16 


21 


29 


17 


22 


30 


17 


23 


31 


18 


24 


32 


18 


25 


34 


19 


26 


36 


20 


27 


38 


21 


28 


40 


22 


29 


42 


23 


30 


44 


24 


31 


46 


25 



Table 2 

35 In operation, the transform circuit 130 outputs macro 

blocks of data to the quantizer 140. Each macro block 
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contains as many as four blocks of luminance data and two 
blocks of chrominance data. A single Q p value is used for 
the macro block. Q p is updated on a macro block by macro 
block basis. 

5 Based on the value of Q p/ the quantizer 140 recalls a 

DC scaling factor for luminance and a DC scaling factor 

for chrominance determined by the scaling functions at the 

value of Q p . For each luminance block, the quantizer 140 

generates a DC lum level signal according to: 

10 DC lum level = DC lum coefficient/DC Scaler for 

Luminance . 

For each chrominance block, the quantizer 140 

generates a DC chrom level signal according to: 

15 Chrom DC level = Chrom DC coefficient/DC Scaler for 

Chrominance . 

The quantizer 140 outputs each DC lum level signal and 
each DC chrom level signal. 

20 The non-linear DC scaling functions of the quantizer 

140 may be implemented in hardware as shown in Fig. 2. 
The Q p signal is input to a memory 300 that stores the 
scaler factors defined by the DC luminance and DC 
chrominance scaler functions. The scaler table 300 may be 

25 substituted by a processor (not shown) that computes the 
scaler factors according to the Q p value. DC luminance and 
DC chrominance signals from the transform circuit 130 are 
isolated by a demultiplexer 310 and routed to respective 
luminance and chrominance division circuits 320 and 330. 

30 The DC lum level and DC chrom level signals are generated 
by these division circuits. 

At the decoder 200, the dequantization circuit 240 
performs an inverse quantization operation with the same 
piece-wise linear scaling functions. Based on the Q p value 

35 of the immediately preceding macro block and any Q p update 
reported in the incoming bitstream, the dequantization 



2685.112183 [Haakftil 60-25-10] 



136403 



10 

circuit 240 recalls appropriate scaling factors for DC 

luminance and DC chrominance signals. For each luminance 

block, the dequantization circuit 240 generates a 

luminance DC coefficient according to: 

5 Lum DC coefficient = DC Lum Level * DC Scaler for 

Luminance. 

For each chrominance block, the scaling circuit 240 

generates a DC coefficient according to: 

10 Chrom DC coefficient « Chrom DC Level * DC Scaler for 

Chrominance. 

The dequantization circuit 240 outputs the reconstructed 
luminance and chrominance coefficients. 

15 The non-linear DC scaling functions of the 

dequantization circuit 240 may be implemented in hardware 
as shown in Fig. 3. The Q p signal is input to a memory 400 
that stores the scaler factors defined by the DC luminance 
and DC chrominance scaler functions. The scaler table 400 

20 may be substituted by a processor (not shown) that 
computes the scaler factors according to the Q p signal. DC 
lum level and DC chrom level signals from the variable 
length encoder 260 are isolated by a demultiplexer 410 and 
routed to respective luminance and chrominance 

25 multiplication circuits 420 and 430. DC luminance 
coefficients and DC chrominance coefficients are generated 
by these multiplication circuits. 

The non-linear DC scaling factors described above are 
appropriate to both intra and inter coding operations. 

30 However, experience teaches that DC coefficients obtained 
from inter coding often are near zero. When quantized 
even by a constant scaling factor, the DC coefficients 
obtained from inter coding often are truncated to zero. 
Accordingly, to reduce complexity in a preferred 

35 embodiments the non-linear scaling function may be 
disabled during inter coding operations. The DC 
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coefficients obtained from inter coding may be quantized 
in a manner similar to the quantization of AC 
coefficients, discussed below. 

The non-linear DC scaling functions maintain high 
5 coding quality at low Q p values and achieve significant bit 
rate savings at high Q p values. The quantizer 140 and 
dequantization circuit 240 of the present invention may 
find use in applications where image quality is a more 
significant consideration than bit rate savings. 

10 Accordingly, in a preferred embodiment, the quantizer 140 
and scaler circuit 240 may have two modes of operation: 
A first mode applying non-linear scaling functions based 
on values of Q p as described above, and a second mode 
applying a constant scaling factor (such as divide by 8) 

15 or even one of a plurality of constant scaling factors 
(such as divide by 8, 4, 2 or 1) . In this embodiment, the 
quantizer 140 generates a scaler flag signal identifying 
which mode of operation is being used. The dequantization 
circuit 240, upon receipt of the scaler flag signal, 

20 invokes an appropriate mode of operation to generate 
coefficients. The scaler flag signal may be a one bit 
signal when discriminating among the two modes, but may be 
larger when discriminating among the two modes and 
additionally identifying which of constant scaling factors 

25 is invoked. 

NON-LINEAR QUANTIZATION OF CHROMINANCE COEFFICIENTS FOR 
INTER CODED BLO CKS 

30 

In inter coding, both DC and AC coefficients of 
chrominance blocks may be close to zero. Coding of such 
coefficients with non-linear scaling functions may improve 
coding quality of the chrominance signal. Additionally, 
35 the non-linear scaling functions of this section may be 
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applied to AC coefficients of chrominance blocks in intra 
coding to achieve coding efficiencies. 

The non-linear scaling function for AC chrominance 
coefficients is piece-wise linear and based on Q p values. 
5 At low values for Q p , the non-linear scaling function for 
AC is a constant value, almost half of the level of the 
scaling function for DC chrominance signals. At high 
levels for Q p , the AC scaling function approximates a Q p /2 
line. At intermediate .levels, the AC scaling function 
10 approximates a Q p /4 line. In one preferred embodiment, the 
AC scaling function for chrominance was derived 
experimentally as shown in Table 3 below: 



Component 


Quantizer for Chrominance when Q p in Range 


1 through 4 


5 through 8 


9 through 24 


25 through 31 


Chrominance 


4 


(Q p + 13)/4 


(Q p + 13)/4 


(Q P -6)/2 



1 5 Table 3 

The AC scaling factors for chrominance also may be stored 
in the quantizer 140 in a memory table indexed by Q p . 

During coding, the quantizer 140 recalls or computes 
20 a scaling factor for AC coefficients based on the value of 
Q p . For each chrominance AC coefficient, the quantizer 140 
generates a corresponding chrominance AC level signal 
according to: 

Chrom AC level = Chrom AC coefficient / Quantizer for 
2 5 Chrominance. 

The quantizer 140 outputs the Chrom AC level signals for 
the AC coefficients. 

The non- linear scaling functions for AC chrominance 
30 coefficients may be implemented in hardware, also shown in 
Fig. 2. The scaler table 300 stores the AC chrominance 
scaler values indexed by Q p . If scaler table 300 is 
substituted by a processor, the processor computes the AC 
chrominance scaler values according to the Q p value. AC 
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chrominance signals from the transform circuit 140 are 
isolated by a demultiplexer 310 and routed to an AC 
division circuit 340. The AC chrom level signals are 
generated by the division circuit 340. 
5 During decoding, the dequantization circuit 240 

recalls the AC scaling factor for chrominance based on the 
value of Q p used for the immediately previous macro block 
and any Q p update provided in the incoming bit stream. For 
each AC chrominance level signal, the scaling circuit 240 
10 reconstructs a corresponding AC chrominance coefficient 
according to: 

Chrom AC coefficient = Chrom AC Level * Quantizer for 

Chrominance . 

15 The scaling circuit 240 outputs the reconstructed 
chrominance AC coefficients. 

The scaling circuit's non-linear AC scaling functions 
may be implemented in hardware, also shown in Fig. 3. The 
scaler table 400 stores the AC chrominance scaler values 

20 indexed by Q p . If scaler table 400 is substituted by a 
processor, the processor computes the AC scaler value 
according to the Q p signal. AC chrom level signals from the 
variable length encoder 160 are isolated by a 
demultiplexer 410 and routed to an AC multiplication 

25 circuit 440. The AC coefficients are generated by the 
multiplication circuit 440. 

QUANTIZER UPDATE 

The encoder 100 and decoder 200 each must use the 
30 same Q p value for video signals to be encoded and decoded 
intelligibly. The encoder 100 may change a value of Q p as 
frequently as every macro block. When the encoder 100 
changes Q p , it reports the change in a Q p update signal in 
the output bitstream. 
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The present invention provides for an improved method 
of reporting updated Q p values to the decoder 200. For each 
Q p update, the magnitude of the Q p adjustment depends not 
only on the update signal but also the previous value of 
5 Q p . A given Q p update signal at a large value of Q p results 
in a relatively large change in Q p . The same Q p update 
signal at a small value of Q p results in a smaller change 
in Q p . The following Table 4 demonstrates Q p adjustments 
made based on the Q p update signal and the value of Q p in 
10 one preferred embodiment of the invention. 



OQuant Code 


Qp Change Based on Qp Value 


1 through 6 


7 through 13 


14 through 21 


22 through 31 


00 


-1 


-1 


-2 


-3 


01 


-2 


-3 


-4 


-5 


10 


1 


1 


2 


3 


11 


2 


3 


4 


5 



Table 4 



20 Providing variable step sizes for Q p updates based on 

the value of Q p provides resistance to saturation for large 
changes of Q p at the encoder 100. The variable step sizes 
provide increased flexibility without requiring additional 
overhead because the previous value of Q p is known at the 

25 decoder 200 and need not be reported in the bitstream. 
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